AI crawlers
2026-07-24 09:47:00The Numbers Returned in Slimmed-Down Form After AI Bots Swamped 90% of Its Traffic
The Numbers, a long-running movie data site founded in 1997, went offline on March 5, 2026 and came back on March 13 in a reduced form after a severe strain from AI crawler traffic. According to PANews, citing reporting by Stephen Follows and comments attributed to founder Bruce Nash, AI crawlers and agents had grown to 90% of the site’s total traffic, pushing servers into repeated overload and failure. The restored version dropped historical charts, individual film detail pages and the site’s Report Builder feature.
The case highlights a broader shift in web economics. PANews said Cloudflare data shows traditional search traffic once worked on a more balanced exchange, with Google crawling about five pages for each human visitor it sent back. By contrast, OpenAI reportedly crawls more than 1,000 pages per visitor, while Anthropic’s ratio exceeds 1:38,000. The article argues that for data-heavy websites with large numbers of public, structured pages, machine traffic can turn from an asset into a cost center because bots consume bandwidth and compute without producing equivalent ad, subscription or referral value.
PANews also pointed to examples from Read the Docs, Wikimedia, SourceHut, iFixit and others to show that bot traffic now carries real infrastructure and labor costs. In that framing, The Numbers is not just an isolated outage story, but a sign of how legacy content and data sites may be forced to rethink architecture, traffic controls and business models as machine requests overtake human browsing.